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Abstract 

We prove a new version of the Holevo bound employing the Hilbert-Schmidt norm instead of 
the Kullback-Leibler divergence. Suppose Alice is sending classical information to Bob using 
a quantum channel, while Bob is performing some projective measurement. We bound the 
classical mutual information in terms of the Hilbert-Schmidt norm by its quantum Hilbert- 
Schmidt counterpart. This constitutes a Holevo-type upper bound on the classical information 
transmission rate via a quantum channel. The resulting inequality is rather natural and 
intuitive relating classical and quantum expressions using the same measure. 
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1. Introduction and Motivation 

Holevo’s theorem [1] is one of the pillars of quantum information theory. It can be informally summarized 
as follows: ‘It is not possible to communicate more than n classical bits of information by the transmission 
of n qubits alone’. It therefore sets a useful upper bound on the classical information rate using quantum 
channel. 

Suppose Alice prepares a state in some system Q, where x G X = {0,..., n} with probabilities p{x). Bob 
performs a measurement described by the POVM elements Ey = Aq, ..., E^n on that state, with measurement 
outcome Y. Let 


P = = '^Pix)Px- 

X 


( 1 ) 
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The Holevo Bound states that [2] 


H{X:Y)<S{p)-J2pix)Sip.), (2) 

X 

where S is the von Neumann entropy and H{X : Y) is the Shannon mutual information of X and Y. Recent 
proofs of the Holevo bound can be found in [3, 4] . 


Consider the following trace distance between two probability distributions p{x) and q(x) on X [5] 


d{p\\q) = ^'^{pix) - q{x)f. 

X 

We can extend the definition to density matrices p and a 


( 3 ) 


d{p\\<7) 


-tr{p-af, 


( 4 ) 


where we use A? for A^A. This is known as the Hilbert-Schmidt (HS) norm [6, 7, 8] (in fact this is one half 
of the HS norm). Recently, the above distance measure was coined the ‘logical divergence’ of two densities 

[ 9 ]. 

We prove a Holevo-type upper bound on the mutual information of X and T, where the mutual informa¬ 
tion is written this time in terms of the HS norm instead of the Kullback-Leibler divergence. It was recently 
suggested by Ellerman [9] that employing the HS norm in the formulation of classical mutual information is 
natural. This is consistent with the identification of information as a measure of distinction [9]. Note that 
employing the Kullback-Leibler divergence in the standard form of the Holevo bound gives an expression 
which can be identified with quantum mutual information, however the ‘coherent information’ is considered 
a more appropriate expression (see also [2] chapter 12). In view of the above we hereby take Ellerman’s idea 
a step further and write a Holevo-type bound based on the HS norm. 

The question whether d{p\\a) is the right measure of quantum mutual information was discussed in [10], 
within the context of area laws. It was used there to provide an upper bound on the correlations between 
two distant operators Ma and Mb, where H is a region inside a spin grid and B is its complement: 


dip^’^\\p^®p^)> 


C{Ma,Mb)^ 

2||M^|PMb|P’ 


( 5 ) 


where C{Ma, Mb) = {Ma 0 Mb) — {Ma){Mb) is the correlation function of Ma and Mb- 

In addition, the HS norm was suggested as an entanglement measure [7, 11], however this was criticized 
in [12], claiming it does not fulfill the so called CP non-expansive property (i.e. non-increasing under every 
completely-positive trace-preserving map). 

In what follows we will prove a Holevo-type bound on the above HS distance between the probability p{x, y) 
on the product space {X, Y) and the product of its marginal probabilities p{x) ■ p{y): 


^d{X,Y\\X(g)Y)<d{p^'^\\p^(S>p^), ( 6 ) 

where 

pP’Q =^p{x)\x){x\(E) Pa:, (7) 

X 

and where 


pQ = ^p(x)Pa;, 

X 

( 8 ) 

p^ = ^p(a:)|x)(a;| 

( 9 ) 


X 
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are the partial traces of and q is the dimension of the space Q. Note that both sides of inequality 
6 are measures of mutual information. Therefore, our claim is that the classical HS mutual information is 
bounded by the corresponding quantum one multiplied by the dimension of the quantum density matrices 
used in the channel. We will also show that 

r||X ®Y)< \L{pP)L{p% (10) 

q 2 

where L{p^) and L{p^) are the Tsallis entropies [13] 

L{p) = tr{p{l-p)), (11) 

also known as the linear entropy, purity [14] or logical entropy of p [9] . 

All the above is proved for the case of projective measurements. However we expect similar results in 
the general case of POVM, in light of Naimark’s dilation theorem (see [15] or [16] for instance). 

In the next section we review some basic properties of quantum logical divergence and then use these 
properties to demonstrate the new Holevo-type bound. 

2. The HS norm and the Holevo-type bound 

Let 

d{p\\(T) = \tr{p-af. (12) 

In what follows we recall some basic properties of the HS distance measure, then we state and prove the 
main result of this paper. 

Theorem 2.1: Contractivity of the HS norm with respect to projective measurements: 

Let p and a be two density matrices of a system S. Let £{p) be the trace preserving operator 


i 


(13) 


where the projections Pi satisfy Pi = p} = Pi = Pi for every i, then 


d{8{p)\\8{a)) < d{p\\a). 


(14) 


Proof: We now write X = p — a. Then X is Hermitian with bounded spectrum, and using Lemma 2 in 
[17] we conclude that 


tr{£p — fcr)^ < tr{p — 


(15) 


Theorem 2.2: The joint convexity of the HS norm 

The logical divergence d{p\\a) is jointly convex. 

Proof: First observe that tr{p^) is convex from the convexity of and the linearity of the trace. Next 
we can write 

d{\pi + (1 - A)p2||Acri + (1 - A)(T2) = (16) 

= + (1 - X)p2) - (Acti + (1 - A)cr2))^ = 


= 2^r{X{pi - cTi) + (1 - \){p2 - a2)f < 

< f + ^—^tr{p2 - (J2f = 

= Xd{pi\\ai) + (1 - X)d{p2\\(T2), 
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where the inequality is due to the convexity of tr(p^). This constitute the joint convexity. 

Theorem 2.3: The monotonicity of the HS norm with respect to partial trace 

Let and be two density matrices, then 

d(/ (g) I/b\\a^ (g) I/b) < (17) 

where b is the dimension of B. 

Proof: One can find a set of unitary matrices Uj over B and a probability distribution pj such that 


3 

(18) 

a^(E)I/b = Y,P3Uj(T^’^Ul 

(19) 


j 


(see [2] chapter 11). Now since d{p\\a) is jointly convex on both densities, we can write 

d{p^ O 7/6||a^ O I/b) <J2 pj- d{UjP^’^U]\\Uja^’^Ul). (20) 

3 

Observe now that the divergence is invariant under unitary conjugation, and therefore the sum in the 
right hand side of the above inequality is d{p"^'^\\a^'^). 

We can now state the main result: 

Theorem 2.4: A Holevo-type bound for the HS trace distance between p{x,y) and p{x) ■ p{y) 
Suppose Alice is using a distribution p{x), where a; is in A = {1,..., n}, to pick one of n densities px in Q. 
She then sends the signal in a quantum physical channel to Bob. We can add an artificial quantum system 
P and write (P, Q) for Alice as: 

Px, ( 21 ) 

where the vectors |a;) are orthogonal. Let p^ and p^ be the partial traces of p^'^. Suppose Bob is measuring 
the system using a projective measurement as in Theorem 2.1, then 

-^d{X,Y\\X®Y) < d(p^’<3||pP®pO), (22) 

where q is the dimension of the space Q. 

Proof: First we consider one more auxiliary quantum system, namely M for the measurement outcome 
for Bob. Initially the system M is in the state Mq = |0)(0|. Let E be the operator defined by Bob’s 
measurement as in Theorem 2.1 above: let {Py}y on Q be defined such that 'Y/y Py = I and 

E{px) = ^ ^ PyPxPy (23) 

y 

One can easily extend E to the space {Q,M) by 

E{p<^\0){0\) = J2PyPPy^\y){y\- (24) 

V 

This can be done by choosing a set of operators, conjugating |0)(0|) to |?/)(?/|). It amounts to writing the 
measurement result in the space M (see also Ch. 12.1.1 in [2]). If we now trace out Q we find 

trQE{p(S)\0){0\) ='^p{y)\y){y\. (25) 

y 
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Moreover, £ can be extended to by 


£ ^y^p(a:)|cc)(a:| ® Px® |0)(0|j = 

= EE p{x)\x){x\ ®PyPxPy ® \y){y\- 


X y 


If we trace out Q we arrive at 


= '^p{y/x)p{x)\x){x\ (g) \y){y\ 




= '^p{x,y)\x){x\ ® \y){y\. 




If we trace out Q we get 


(26) 


(27) 


Finally, we can extend f to (g) p^Q’^'> by 

^ ® = (28) 

= EE p{x)\x){x\®PypPy (g) \y){y\. 

X y 

trQ£{p^ ® = (29) 

= EE^^I^^(^I ®piy)\y)iy\ = 

X y 

= (E?'^l^)(^l) ® C^Py\y){y\)- 

X y 

We can now use the properties stated in the above theorems and Eqs. 27 and 29 to deduce 

d{pP'^\\pP ® p^) = ® p«’^«) > (30) 

> d{£{pP'^'^°)\\£{pP g) p^'^°)) > 

> d(<rQf(p^’'3’^°) ®7,||trQf(p^ gpC^.Mo)) ^ ^ 

= hiX,Y\\X(^Y), 

q 

where in the first inequality we have used Theorem 2.1 and in the second inequality Theorem 2.3. The final 
equality is an easy consequence of the definition of the HS norm. 

Corollary: Suppose Alice is sending classical information to Bob using a quantum channel Q, Bob 
measures the quantum state using a projective measurement defined above (having results in space Y). 
Under all the above assumptions 


U{X,Y\\X ®Y) <\L{pP)L{p% 
q 2 


(31) 


where L{p^) and L{p^) are Tsallis entropies of the second type (the quantum logical entropies) of p^ and p^. 
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Proof: Clearly (see also [18]) 


d{p^’^\\p^ ® p^) = - p^ ® P^))- (32) 

It is easy to see (by a matrix representation) that for as in Eq. 21 

tr(p^’^(l - p^ ® p^)) = L{p^’^), (33) 

therefore 

d{p^’^\\p^ ^ p^) = ^L{p^’^) - ^L{p^ ®p^). (34) 

However, L{p^’^) < L{p^) + L{p^), and L{p^ ® p^) = L{p^) + L{p^) — L{p^) ■ L{p^), (see [18] Theorem 
II.2.4 and Theorem II.3), therefore 


d{p^'^\\p^ ® p^) < ]^L{p^) ■ L{p^). (35) 

Combining this with Theorem 2.4 we find 

id(X, F||X 0 y) < \L{pP)L{p^). (36) 

q 2 

Example: Suppose Alice sends the state |0) with probability 1/2 and the state \'ip) = cos0|O) +sin0|I) 
with probability 1/2, then 


pP^Q = ^|0)(0| 0po + ^|1)(1| 

where po = |0)(0| and pi = |V')(V'I- By partial tracing we get 


1 / 

^ I 

0 ' 


cos^ 9 

cosdsin6> \ 

2 ( 

0 

0 

) + 2 ( 

cos9 sin 9 

sin^ 9 ) 


and pP is a balanced coin. The eigenvalues of p'^ are (1 ± cos6*)/2 and therefore 

L{p^) = 1 — [(I + cos6>)^/4 + (I — cos6*)^/4] = - sin^ 9. 
Also L{pP) = 1/2 and q = 2, hence 

d(A,r||A®y) < ^sin2 6» < 1/4. 


(37) 


(38) 


(39) 


(40) 


The left hand side of the above inequality is a measure of the classical mutual information according to 
the HS norm between X and Y. The very fact that it is smaller than the Tsallis information measure of 
X (which is 1/2) means that the quantum channel restricts the rate of classical information transfer, where 
the mutual information is measured by the HS norm and the source of information X is measured by Tsallis 
entropy. This is analogous to Holevo’s upper bound in the framework of Tsalis/linear entropy. We find this 
result similar in spirit to the well-known limitation on the rate of classical information transmission via a 
quantum channel (without utilizing entanglement): one cannot send more than one bit for each use of the 
channel using a one qubit channel. 

In the above example, if po and pi are mixed states, then by the same argument we can show that: 

diX,Y\\X(^Y)<^L{pQ) (41) 
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This gives a bound on the classical mutual information using the quantum ‘logical entropy’ (the Tsallis 
entropy). 

3. Discussion 

We proved a Holevo-type bound employing the Hilbert-Schmidt distance between the density matrices on 
the product space {X, Y) and the tensor of the two marginal density matrices on X (g) T. Using a different 
measure of mutual information, we showed that this Holevo-type upper bound on classical information 
transmission can be written as an inequality between the classical mutual information expression and its 
quantum counterpart. 

It seems that by utilizing Naimark’s dilation [15, 16], the above result can be generalized to any POVM, 
if one is willing to employ the suitable channel in a higher dimensional Hilbert space. 

As was claimed in [18], the divergence distance used above is the natural one in the context of quantum 
logical entropy [9]. Being the ‘right’ measure of mutual information in quantum channels passing classical 
information, we expect that this formalism would be helpful in further studying various problems such as 
channel capacity theory, entanglement detection and area laws. 
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